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(57) Abstract: Directional haptic feedback provided in a haptic feedback interface device (200). An interface device (200) includes 
al least two actuator assemblies (202,204), which each includes a moving intertial mass (206/210). A single control signal provided to 
the actuator assemblies (202,204) al different magnitudes provides directional inertial sensations felt by the user. A greater magnitude 
waveform can be applied to one actuator (208/212) to provide a sensation having a direction approximately corresponding to a 
position of that actuator in the housing. In another embodiment, the actuator assemblies each includes a rotary inertial mass and the 
^ control signals have different duty cycles to provide directional sensations. For power consumption efficiency, the control signals 
can be interlaced or pulsed at a different frequency and duty cycle to reduce average power requirements. 
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DIRECTIONAL TACTILE FEEDBACK 
FOR HAPTIC FEEDBACK INTERFACE DEVICES 



5 BACKGROUND OF THE INVENTION 

The present invention relates generally to interface devices for allowing humans to 
interface with computer systems, and more particularly to computer interface devices that allow 
the user to provide input to computer systems and allow computer systems to provide haptic 
feedback to £he user. 

10 A user can interact with an environment displayed by a computer to perform functions 

and tasks on the computer. Common human-computer interface devices used for such 
interaction include a mouse, joystick, trackball, gamepad, steering wheel, stylus, tablet, pressure- 
sensitive sphere, or the like, that is connected to the computer system. Typically, the computer 
updates the environment in response to the user's manipulation of a physical manipulandum such 

15 as a joystick handle or mouse, and provides visual and audio feedback to the user utilizing the 
display screen and audio speakers. The computer senses the user's manipulation of the user 
manipulandum through sensors provided on the interface device that send locative signals to the 
computer. In some interface devices, kinesthetic force feedback or tactile feedback is also 
provided to the user, more generally known herein as *liaptic feedback." These types of 

20 interface devices can provide physical sensations which are felt by the user manipulating a user ) 
manipulandum of the interface device. One or more motors or other actuators are coupled to the 
housing or the manipulandum and are connected to the controlUng computer system. The 
computer system controls output forces in conjunction and coordinated with displayed events 
and interactions by sending control signals or commands to the actuators. 

25 Many low-cost haptic devices provide inertially-grounded tactile feedback, in which 

forces are transmitted with respect to an inertial mass and felt by the user, rather than kinesthetic 
feedback, in which forces are output directly in the degrees of freedom of motion of a moving 
manipulandum with respect to a physical (earth) groimd. For example, many currently-available 
gamepad controllers include a spiiming motor with an eccentric mass, which outputs force 

30 sensations to the housing of the controller in coordination with events occurring in a game. In 
some haptic mouse devices, pins, buttons, or the housing of the mouse can be actuated in 
accordance with interaction of a controlled cursor with other graphical objects, which the user 
feels by touching those housing areas. 

One problem with such inexpensive haptic controllers is their limited ability to convey 
35 different types of force sensations to the user. A device that provides more flexibility for the 
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developer in tuning and adjusting the feel of haptic sensations is more desirable. In addition, 
inertial controllers currently available can only provide output pulses and vibrations in the 
general directions of the rotating mass. The sensations thus feel to the user as if they are not 
output in any particular direction, but are simply output on the housing of the device. However, 
5 many events in games and other computer-implemented environments are direction-based and 
would benefit firom a directionality to haptic sensations which current inertial haptic devices 
cannot provide. 



SUMMARY OF THE INVENTION 

10 The present invention is directed toward providing directional haptic feedback in a haptic 

feedback interface device. Inventive power-efficiency features for the haptic devices used for 
such directional feedback are also described. 

More particularly, an interface device of the present invention provides directional haptic 
feedback to a user, the interface device in communication with a host computer. The device 

IS includes a housing physically contacted by the user and at least one sensor for detecting user 
input. At least two actuator assemblies each includes a moving inertial mass, and are positioned 
in the housing to cause directional inertial sensations on the housing. A single control signal is 
provided to each of the actuator assemblies at different magnitudes to provide the directional 
inertial sensations felt by the user. Preferably, a greater magnitude of the wavefonn is applied to 

20 a particular one of the actuator assembhes to provide a sensation having a direction 
approximately corresponding to a position of that particular actuator assembly in the housing, 
e.g. a greater magnitude is applied to a left actuator assembly to provide a sensation having a left 
direction etc. 

A local processor can be included that receives a higjh level command firom the computer 
25 and controls the actuator assemblies. The high level command can include a balance parameter 
that indicates how to divide an output current between the actuator assemblies to provide a 
desired location for the directional inertial sensation along an axis between the actuator 
assemblies. The actuator assemblies can oscillate said inertial mass linearly, or rotate an 
eccentric rotating mass. The control signal can be divided into two control signals, one being out 
30 of phase with the other and each sent to one of the actuator assemblies. A method of the present 
invention similarly allows output of directional inertial sensations. 

In another aspect of the present invention, an interface device provides directional haptic 
feedback to a user and includes a housing physically contacted by the user and at least one sensor 
for detecting user input. At least two actuator assemblies each include a rotary inertial mass that 
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is driven uni-directionally. The actuator assemblies are positioned in the housing to cause 
directional inertial sensations on the housing, where a control signal is provided to each of the 
actuator assemblies at a different duty cycle to provide the directional inertial sensations felt by 
the user. For example, a commanded magnitude of the control signal can be appUed to a left one 
5 of the actuator assemblies to provide a sensation having a left direction; similar control can be 
provided for a right direction. Hig|h levels command including a balance parameter can be used, 
indicating how to divide output vibration magnitudes between the actuator assemblies. One of 
the control signals can be out of phase with the other. The control signals can also be interlaced 
such that the control signals are never on at the same time. Alternatively, when one of the 
10 control signals is on at the same time as the other, one or both signals are pulsed at a 
predetermined jfirequency and duty cycle to reduce average power requirements of the actuator 
assemblies. A method of the present invention similarly allows output of directional inertial 
sensations. 

The present invention advantageously provides directional tactile feedback sensations for 
15 a tactile feedback device using low cost actuators. These sensations allow for a much greater 
variety of sensations in these types of haptic devices, allowing the experience of playing a game 
or interacting with other types of computer applications to be more fulfilling for the user. Power 
eflBciency features also allow low-power device embodiments to provide the directional haptic 
sensations disclosed herein. 

20 These and other advantages of the present invention will become apparent to those 

skilled in the art upon a reading of the following specification of the invention and a study of the 
several figures of the drawing. 



BRIEF DESCRIPTION OF THE DRAWINGS 

25 

FIGURE 1 is a perspective view of a gamepad haptic feedback system suitable for use 
with the present invention; 

FIGURES 2a and 2b are top plan sectional and side elevational views, respectively, of an 
embodiment of the haptic interface device that includes two actuators to provide directional 
30 inertial feedback; 

FIGURE 3 is a functional diagram illustrating a control method of the present invention 
for use with the two actuator embodiment of Figs. 2a-2b; 
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FIGURE 4 is a diagrammatic representation of the interface device and the possible 
approximate locations at which the user may perceive a resultant inertial force; 



FIGURES 5a and 5b are top plan sectional and side elevational views, respectively, of 
another embodiment of the haptic interface device including two actuators and rotating inertial 
S masses; 

FIGURE 6 is a graph showing a time vs. magnitude relationship of a desired sine wave 
vibration and a control signal for providing that vibration; 

FIGURE 7 is a graph showing another example of a time vs. magnitude relationship of a 
desired sine wave vibration and a control signal for providing that vibration; 

10 FIGURES 8a and 8b are graphs showing control signals for rotating the masses by the 

two different actuator assemblies and to independently control magnitude and frequency; 

FIGURES 9a, 9b, and 9c are graphs illustrating a power allocation method of the present 
invention for control signals having different frequencies and/or overlap; 

FIGURES 10a, 10b, 10c and lOd are gr£^hs illustrating control signals in a control 
1 5 method of the present invention to provide directional tactile feedback; and 

FIGURE 11 is a block diagram illustrating one embodiment of a haptic feedback system 
suitable for use with the present inventions. 



DETAILED DESCRIPTION OF PREFERRED EMBODIMEPfTS 

20 

FIGURE 1 is a perspective view of a haptic feedback interface system 10 suitable for use 
with the present invention and cs^able of providing input to a host computer based on the user's 
manipulation of a device and capable of providing haptic feedback to the user of the system 
based on events occurring in a program implemented by the host computer. System 10 is shown 
25 in exemplary form as a gamepad system 10 that includes a gamepad interface device 12 and a 
host computer 14. 

Gamepad device 12 is in the form of a handheld controller, of similar shape and size to 
many gamepads currently available for video game console systems. A housing 15 of the 
interface device 10 is shaped to easily accommodate two hands gripping the device at the 
30 gripping projections 16a and 16b. In the described embodiment, the user accesses the various 
controls on the device 12 with his or her fingers. In alternate embodiments, the interface device 
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can take a wide variety of forms, including devices that rest on a tabletop or other surface, stand- 
up arcade game machines, laptop devices or other devices worn on the person, handheld or used 
with a single hand of the user, etc. 

A direction pad 18 can be included on device 12 to allow the user to provide directional 
5 input to the host computer 14. In its most common implementation, the direction pad 18 is 
approximately shaped like a cross or disc having four extensions or directional positions 
radiating from a central point at a 90-degree spacing, where the user can press down on one of 
the extensions 20 to provide a directional mput signal to the host computer for the corresponding 
direction. 

10 One or more finger joysticks 26 can be included in device 12 that project out of a 

surface of the housing IS to be manipulated by the user in one or more degrees of freedom. For 
example, the user can grasp each of grips 16a and 16b of the device and use a thumb or finger to 
manipulate the joystick 26 in two degrees of freedom (or three or more degrees of freedom in 
some embodiments). This motion is translated into input signals provided to the host computer 

15 14, and can be different signals than those provided by the direction pad 18. In some 
embodiments, additional linear or spin degrees of freedom can be provided for the joystick. In 
other embodiments, a sphere can be provided instead of or in addition to the joystick 26, where 
one or more portions of the sphere can extend out of left, right, top and/or bottom sides of the 
housing 15 so that the sphere may be rotated in place by the user within two rotary degrees of 

20 freedom and operate similarly to a joystick. 

Instead of or in addition to buttons 24, joystick 26, and direction pad 18, other controls 
may be placed within easy reach of the hands grasping the housing 15. For example, one or 
more trigger buttons can be positioned on the underside of the housing and can be pressed by the 
fingers of the user. Other controls can also be provided on various locations of the device 12, 
25 such as a dial or slider for throttle control in a game, a four- or eight-way hat switch, knobs, 
trackballs, a roller or sphere, etc. Any of these controls can also be provided with haptic 
feedback, such as tactile feedback. 

Furthermore, the housing itself which is contacted by the user when the user operates 
the device preferably provides tactile feedback, as described in greater detail below. A moveable 
30 part of the housing can also provide tactile feedback. Thus, both the housing can provide tactile 
feedback and the directional pad 18 (or other controls) can provide separate tactile feedback. 
Each other button or other control provided with haptic feedback can also provide tactile 
feedback independently from the other controls. 

Interface device 12 is coupled to host computer 14 by a bus 32, which can be any of 
35 several types of communication media. For example, a serial interface bus, parallel interface 
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bus, or wireless communication link can be used (radio, infrared, etc.). Specific implementations 
can include Universal Serial Bus (USB), IEEE 1394 (Firewire), RS-232, or other standards. In 
some embodiments, the power for the actuators of the device can be supplied or supplemented 
by power transmitted over the bus 32 or other channel, or a power supply/storage device can be 
5 provided on the device 12. 

The interface device 12 includes circuitry necessary to report control signals to the host 
computer 14 and to process command signals from the host computer 14. For example, sensors 
(and related circuitry) can be used to sense and report the manipulation of the controls of the 
device to the host computer. The device also preferably includes circuitry that receives 
10 command signals from the host and outputs tactile sensations in accordance with the command 
signals using one or more device actuators. Gamepad 12 preferably includes actuator assemblies 
which are operative to produce forces on the housing of the gamepad 12. This operation is 
described in greater detail below with reference to Fig. 2. 

Host computer 14 is preferably a video game console, personal computer, workstation, or 

15 other computing or electronic device which typically includes one or more host microprocessors. 
One of a variety of home video game systems, such as systems available from Nintendo, Sega, or 
Sony, a television "set top box'* or a "network computer", etc. can be used. Alternatively, 
personal computers, such as an IBM-compatible or Macintosh personal computer, or a 
workstation, such as a SUN or Silicon Graphics workstation, can be used. Or, the host 14 and 

20 device 12 can be included in a single housing in an arcade game machine, portable or handheld 
computer, vehicular computer, or ottier device. Host computer system 14 preferably implements 
a host application program with which a user is interacting via peripherals and interface device 
12. For example, the host application program can be a video or computer game, medical 
simiilation, scientific analysis program, operating system, graphical user interface, drawing/CAD 

25 program, or other application program. Herein, computer 14 may be referred as providing a 
"graphical environment/', which can be a graphical user interface, game, simulation, or other 
visual environment. The computer displays "graphical objects" or "computer objects," which are 
not physical objects, but are logical software imit collections of data and/or procedures that may 
be displayed as images by computer 14 on display device 34, as is well known to those skilled in 

30 the art. Suitable software drivers which interface software with haptic feedback devices are 
available from Immersion Corporation of San Jose, California. 

Display device 34 can be included in host computer 14 and can be a standard display 
screen (LCD, CRT, flat panel, etc.), 3-D goggles, projection display device (e.g., projector or 
heads-up display in a vehicle), or any other visual output device. Typically, the host application 
35 provides images to be displayed on display device 34 and/or other feedback, such as auditory 
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signals. For example, display screen 34 can display graphical objects jfrom a GUI and/or 
application program. 



In other embodiments, many other types of interface or control devices may be used with 
the present inventions described herein. For example, a mouse, a trackball, a joystick handle, 

5 steering wheel, knob, stylus, grip, touchpad, or other device can benefit from inertial haptic 
sensations as described herein. Li addition, other types of handheld devices are quite suitable for 
use with the presently-described inventions, such as handheld remote control device or cellular 
phone or handheld electronic device or computer can be used with the haptic feedback 
components described herein. The sensations described herem can, for example, be output 

10 perpendicularly firom a device's surface or can be output on a joystick handle, trackball, stylus, 
grip, wheel, or other manipulatable object on the device, or in a desired direction or sweep. 

In operation, the controls of interface device 12 are manipulated by the user, which 
indicates to the computer how to update the implemented application program(s). An electronic 
interface included in housing 15 of device 12 can couple the device 12 to the computer 14. The 
15 host computer 14 receives the input jfrom the interface device and updates an appHcation 
program in response to the input. For example, a game presents a graphical environment in 
which the user controls one or more graphical objects or entities using the direction pad 18, 
joystick 26 and/or buttons 24. The host computer can provide force feedback commands and/or 
data to the device 12 to cause haptic feedback to be output by the device. 

20 FIGURES 2a and 2b are top plan sectional and side elevational views, respectively, of an 

embodiment 100 of device 12 including two actuators for use with one embodiment of the 
present invention for directional inertial feedback. The embodiment shown may be used with 
any inertial interface device, but may be best suited to handheld devices which are grasped by the 
user with two hands at different parts of the device housing. The embodiment is described as a 

25 gamepad for explanatory purposes. Gamepad housing 101 encloses a gam<epad tactile interface 
device 12, which is manipulated by the user to provide input to a host computer system. The 
user typically operates the device by grasping each grip 16 with one hand and using fingers to 
manipulate the input devices on the central part of the housing 101 . 

Housing 101 preferably includes two harmonic drive actuator assembUes 102 and 104. 

30 These actuator assemblies can be implemented in any of a variety of ways. Most of the suitable 
actuator assembUes provide an inertial mass that can be harmonically oscillated, and also include 
a centering spring force on the inertial mass to allow efficient and highly-controllable inertial 
sensations. In one embodiment, the actuator assembhes described herein with reference to Figs. 
2-8 can be used. In other embodiments, the actuator assembUes 102 and 104 can be the 

35 harmonic drive actuator assembUes which provide a rotary motor (or other actuator) coupled to a 
flexure that causes an inertial mass to osciUate approximately Unearly, thereby providing tactile 
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feedback. The inertial mass can be the motor itself. The actuators are controlled harmonically, 
similar to the actuators described herein, e.g. with a periodic control signal such as a sine wave. 
The inertial mass can be oscillated in any direction; for example, one desirable direction is up 
and down, as indicated by arrows 106. In other embodiments, other types of actuators can be 
5 used, such as voice coil (moving coil) actuators. In yet other embodiments, rotary inertial 
masses can be used, such as an eccentric mass provided on a shaft of a rotary motor, as described 
below. 

The harmonic drive actuator assemblies 102 and 104 are preferably positioned with the 
maximum spatial displacement between them that is allowed by the device. For example, in the; 
gamepad embodiments, the assemblies 102 and 104 can be placed within different hand grips 16 
of the gamepad. This allows the perception of directional forces to be more easily experienced 
by the user. The actuator assemblies 102 and 104 are also preferably the same in their relevant 
characteristics: actuator size, spring stiffiiess, inertial mass, and damping (if provided). This 
allows the inertial forces to be about the same at each end of the device and allows the balancing 
of direction to be more effective. Other embodiments can include di£ferent spacing and/or sizing 
of the actuator assemblies. 

FIGURE 3 is a functional diagram illustrating a control method of the present invention 
for use with the two actuator embodiment 100 described with reference to Figs. 2a-2b to provide 
directional tactile feedback that can be spatially placed by the user at a location between the two 
actuator assemblies. A time-vs-current graph 130 of Fig. 3a depicts an initial control waveform 
132 which provides a base vibration to be output by the actuators of the device and has a desired 
frequency, duration, and ma^tude. The waveform is a forcing function that harmonically 
drives a mass both positively and negatively along the axis. This waveform can be adjusted as 
desired with various parameters. For example, as shown in tiie graph 134 of Fig. 3b, an envelope 
136 can be applied to provide a waveform 138 that has an adjusted magnitude at desired levels at 
different points in the duration of the vibration. In other applications, no envelope need be 
applied. 

When the control waveform 138 is to be output to the actuator assemblies (or a control 
signal is output that implements the control waveform 138), &e same basic waveform shape is 
30 provided to each actuator assembly, but the magnitudes are scaled so that the commanded 
current is divided between the two actuator assepiblies 102 and 104. To provide a vibration or 
other inertial force sensation that has no perceived direction to the user, both actuator assemblies 
are provided with an equal amount of current, so that equal magnitude vibrations are output from 
each actuator. If, however, the inertial sensation is to have a perceived direction, then one 
35 actuator is provided with more current than the other, i.e. greater magnitude inertial forces are 
output by one actuator than the other actuator. Graphs 140 and 142 illustrate control waveforms 
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derived from the wavefonn of graph 134 sent to the actuator assemblies 102 and 105. The 
graphs indicate a situation in which a "left" direction is to be perceived by the user. The 
wavefonn 144 of graph 340 is a 70% magnitude of the commanded 100% magnitude and is sent 
to the left actuator 104 on the left side of the device. The waveform 146 of graph 142 has a 30% 
S commanded magnitude (the remaining amount of current) and is sent to the actuator 102 on the 
right side of the device. If a right direction is to be output, then the actuator 102 on the right side 
of the device is provided with the greater amount of current (larger magnitude). The user 
perceives a stronger vibration on one side of the device as a directional vibration. 

The tactile sensation directionality can be usefiil in many applications, such as games. If 
10 for example, the user's vehicle in a game crashes into a barrier on the left, the left actuator can 
output a stronger vibration to indicate the direction of this colUsion. If a player's character is 
punched on his left side, a left vibration can be output. 

Depending on the division of magnitude between the two actuators, the user perceives the 
output inertial sensations at a location somewhere between the two actuator assemblies; the 

15 stronger one force is, the closer to that actuator assembly the user perceives the resultant force to 
be output. For example, FIGURE 4 shows a representation of the gamepad 100, where the 
actuator assembUes 102 and 104 are represented. An axis 152 indicates the possible 
approximate locations at which the user may perceive a resultant inertial force. From the 
wavefonn commands of Fig. 3, the left actuator assembly 104 is outputting a greater force (70%) 

20 than the right actuator assembly 102 (30%), so the user.perceiyes the inertial forces to be output 
approximately at location 150 of the housing 101, which is located closer to the left actuator in 
proportion to its greater magnitude. This effective since the inertial sensations are commanded 
by the same basic waveform and thus are output in synchronization with the same frequency. 
The division of magnitude can be changed in any desired way to output a perceived direction at 

25 any point along the axis 1 52. 

One way of commanding the direction in this way is to specify a **balance" parameter. 
For example, the host computer can provide high level commands to a local processor on the 
device 12. The high level commands can include parameters such as frequency, magnitude, 
envelope attack and fade parameters, and a balance parameter. The balance parameter, for 

30 example, can be specified as a niraiber in a range. For example, a range of 0 to 90 can be used to 
simulate a vector force direction. A 45 value indicates exact balance between the actuator 
assembly outputs, so that inertial forces are felt equally on both sides of the device. A value 
below 45 indicates greater force magnitude on the left side, and so on to the 0 value, which 
indicates 100% of the commanded current is controlling the left actuator and the right actuator 

35 has no output. A 90 value controls the right actuator to have fiill output and the left actuator to 
have no output. Altematively, a percentage can be specified and applied to a default actuator 
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assembly, such as the left one; e.g., a value of 65 would thus indicate that 65% of the 
commanded magnitude should go to the left actuator, while the remaining 35% of the 
commanded magnitude would go to the right actuator. A local processor can perform the scaUng 
of the two output control signals in accordance with the commanded balance and provide the 
5 appropriate scaled signal to each actuator assembly 102 and 104. 

Alternatively, the host computer can directly command the balance feature by sending 
scaled control signals to each actuator directly, or by directly instructing a local processor to send 
host-transmitted control signals to each of the actuators. 

An important feature of the embodiment 100 is that both actuator assemblies preferably 
10 remain synchronized and in phase. A single waveform is used to control both actuators, but the 
magnitude of the waveforms is changed to indicate a direction or off-balance feeling to the 
inertial forces. Thus, the masses of each of the actuator assemblies oscillates in unison, except 
that one of the masses accelerates faster and moves a greater distance from the origin position of 
the mass, causing greater force from that actuator assembly. This allows the directionality to be 
15 better perceived by the user because a single sensation is being created with spatial placement. 
In other embodiments, the actuators can be unsynchronized, but this tends to provide less 
directionality to the force sensations. 

Additional actuators can be included in other embodiments. For example, two actuators 
can be provided on the left side, and two actuators can be provided on the right side to increase 

20 magnitude vibration. Or, additional actuators can be positioned at front, back, top, or bottom 
positions to provide additional directions to the tactile feedback. Preferably, each actuator 
receives the same waveform at a desired fraction of the available power to achieve the 
directionality. For example, if three actuator assemblies are provided in a triangular 
configuration, the perceived location of a resultant inertial force sensation is placed somewhere 

25 between all three actuator assembUes, effectively adding a second dimension to the force 
location. This location can be adjusted by adjusting the magnitude of current to each actuator 
assembly appropriately. 

Another important directional effect that can be achieved with the embodiment 100 is a 
"sweep" of inertial forces. Such a sweep causes the balance of current between actuator 

30 assemblies to be continuously changed so that the perceived location of the inertial forces is 
smoothly moving from right to left or left to right in a two-actuator embodiment (or in other 
directions as implemented). For example, the local processor can be commanded by a high level 
sweep command to change the balance parameter continuously and evenly from 0 to 90 (using 
the convention described above) over a specified time duration. By changing the time duration, 

35 a fast sweep or a slower sweep can be commanded. The user then feels inertial forces starting at 
the left of the device and moving approximately along axis 152 toward the rigiht, and ending at 
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the right actuator, as the local processor changes the percentage of commanded cxirrent that each 
actuator assembly receives during the sweep. Thus, for example, if the user's car in a game gets 
collided on the right side, an inertial vibration can be quickly (e.g. over 1-2 seconds) swept from 
the right side to the left side to convey the direction of this collision. In an embodiment 
5 including three or more actuator assemblies, the force location can be swept in two dimensions 
by dividing current so that the perceived location is moving in a desired path between all of the 
actuators. 

Other control features can include the use of phase shifts between the left and right 
actuator assemblies in addition (or alternatively) to the balance control between left and right 

10 actuator assemblies. For example, a phase shift of 90 degrees between the control waveforms 
sent to each of the actuators (and thus between the oscillations of the inertial mass) can give the 
user the impression of a doubled frequency, with an alternating beating effect (left-right). This 
can allow higher magnitude force sensations at a perceived higher frequency because the large 
displacements of the inertial mass associated with a low frequency are still occurring, but the 

IS resultant felt by the user is the higher frequency. Also, the resonance frequency can be useful. 
For example, if the resonance frequency of tiie actuator assemblies is about 40 Hz, a strong peak 
magnitude occurs at 40 Hz, and another strong peak at 80 Hz by running ftie two (same-type) 
actuator assemblies 90 degrees out of phase. 

Furthermore, a small phase shift, such as 5 to 10 degrees, feels to the user like the master 
20 frequency but each pulse feels a little stronger because the user has the impression that each 
impulse of force lasts longer. In addition, a larger phase shift, such as 10 to 30 degrees, can give 
the user an interesting sensation of a "stutter step," Le., a quick pop-pop of force, during each 
cycle of a vibration. Phase can also be sent to device as a parameter in a high level command. 

Finally, a large phase shift of 180 degrees can cause tactile sensations to be very 
25 interesting to the user, since while the inertial mass of one actuator is traveling up and hitting a 
travel limit, the other inertial mass of the other actuator is traveling down and hitting the lower 
limit. This can impose a torque about the center of the gamepad or other interface device, e.g. a 
feeling like the entire gamq)ad is rotating about a c«iter point approximately on axis 152. Oil 
one cycle, the torque is in one rotational direction, and on the next cycle, the direction of the 
30 torque reverses, thus providing an alternating torque. This sensation can feel more intense to the 
user than when the inertial masses are moving in phase. In another embodiment, a square wave 
can be commanded which has been normalized, e.g. provided only in one direction, such as the 
positive direction to cause the inertial mass to move only in one direction from its origin 
position. That waveform can then be sent 180 degrees out of phase between the two actuator 
35 assembUes. This can result in a clockwise beating torque, where the torque never switches 
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direction. Alternatively, if the waveform is instead normalized to a negative direction, a 
counterclockwise beating torque results. 



In another embodiment, the left-right inertial sensations from actuator assemblies 102 
and 104 can be coordinated with stereo (left-right) audio that is, for example, output by the host 
5 computer. For example, an airplane can be flying over the user in a game or audio-video 
presentation on a host computer, television, or other device, where the sound of the airplane is 
output starting from a left speaker and moving over to a right speaker to present a positional 
audio effect. Force sensations output by the left and right actuator assemblies can, in 
coordination, start their output on the left side and move over to the right side of the interface 
10 device in unison with the sound. The force sensations can also be synchronized with displayed 
visual images, such as a panning camera view. In some embodiments, the magnitude of the 
force sensations can also be correlated to the loudness of the sound, for example. The host 
computer can command the force sensations to be synchronized with audio or video that the host 
is also controlling. 

15 All of the above-described tactile effects, and variations thereof, can be combined in 

various ways to achieve a desired effect. A wide variety of tactile effects are thus possible using 
the control schemes of actuator assemblies of the present invention. 

FIGURES 5a and 5b are top plan sectional and side elevational views, respectively, of 
another embodiment 200 of device 12 including two actuators for use with another embodiment 

20 of the present invention for directional inertial feedback. Gamepad housing 201 includes two 
actuator assemblies 202 and 204. In the above embodiment, the actuator assemblies include an 
inertial mass that can be hnearly harmonically oscillated; in the present embodiment described 
in Figs. 5a and 5b, the actuator assemblies 202 and 204 include rotary inertial masses, where an 
eccentric rotating mass (ERM) 206 is coupled to a rotating shaft of an actuator 208 in assembly 

25 202 in the right grip 16b, and where an eccentric rotating mass (ERM) 210 is coupled to a 
rotating shaft of an actuator 212 in assembly 204 in the left grip 16a. Actuator 208 is rigidly (or 
comphantly) coupled to the housing 201 in grip 16a, and actuator 212 is rigidly (or compliantly) 
coupled to the housing 201 in grip 16b. Eccentric masses 206 and 210 can be wedge-shaped, 
cylinder-shaped, or otherwise shaped. When rotated, the masses cause the housing 201 to 

30 vibrate as the eccentric inertial mass moves within its range of motion. 

The harmonic drive actuator assembUes 202 and 204 are preferably positioned with the 
maximum spatial displacement between them that is allowed by the device. For example, in the 
gamepad embodiments, the assemblies 202 and 204 can be placed within different hand grips 
16a and 16b of the gamepad. This allows the perception of directional forces to be more easily 
35 experienced by the user. In other embodiments, the assembUes 202 and 204 can be positioned in 
other areas of the housing, although still preferably separated by a significant spatial distance, 
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e.g. on opposite sides of the housing. The actuator assemblies 202 and 204 can be the same in 
their relevant characteristics: actuator size, inertial mass, and damping (if provided) to allow the 
inertial forces to be experienced about the same at each end of the device and allows the 
directional sensations to be effective. In other embodiments, actuator assemblies having 
S different sizes or other characteristics can be used. 



ControUing Tactile Sensations with Unidirectional ERM Motors 

The inertial rotary actuator assemblies described for Figs. 5a-5b can output vibrations and ^ 
jolts to the user of the interface device 12 when the inertial masses are rotated. In these methods, 
10 frequency and magnitude of a periodic haptic effect can be varied independently and displayed 
on a single degree of freedom unidirectionally-driven actuator, such as (but not restricted to) an 
ERM actuator. 

Many standard gamepad vibrotactile devices rotate ERMs at a fixed magnitude and 
frequency, the two of which are tigjitly coupled. For example, high frequency vibrations are 

15 necessarily high magnitude, while low frequency vibrations are necessarily low frequency. The 
method of control described for use in the embodiment of Figs. 5a-5b and described in the 
above-referenced application allows independent variation of magnitude and frequency of a 1 
degree-of-freedom (DOF), unidirectionally-driven rotary actuator, i.e., no expensive bi- 
directional current drivers need be employed, since the ERM need only be driven in one rotary 

20 direction. The technique is significant because it enables an ERM to create complex vibrations, 
like decaying sinusoids or superimposed waveforms. An ERM in prior devices had a magnitude 
that was roughly linearly coupled to its speed. The present invention, utilizing no extra clutches, 
circuitry, or mechanical parts and using only these control methods (e.g. implemented in 
firmware of a local microprocessor or other controller of the device 12), can play a range of 

25 frequencies at any amplitude using an ERM motor. Note that the control methods described 
herein can be applied not only to rotational motors but other types of 1 DOF actuators, rotational 
and linear, including moving magnet motors,, solenoids, voice coil actuators, etc. 

In this method of control, a frequency command, a magnitude command, and a function 
(i.e. sine wave, square wave, triangle wave) can be supplied as parameters or inputs to the 
30 firmware. This follows an existing Immersion/DirecfX protocol used in personal computers 
such as PC's, in which a vibration is controlled with magnitude, frequency, and fiinction type 
parameters (and additional parameters, if desired). The equivalent of these parameters can be 
supplied in other embodiments. 
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An example is illustrated in the graph 250 shown in FIGURE 6, showing a time vs. 
magnitude relationship. A sine wave 252 of frequency 5 Hz and 50% magnitude is shown as the 
desired vibration to be output by the device (this, and all subsequent similar figures, capture 1 
second of input and output signals). The present control method determines where each period 
5 of the waveform begins (or should begin), then raises a control signal 254 to a high or "on" level 
for a specific duration once per period; the control signal 254 is "off" or low during the other 
times. The "on" level energizes tiie motor and causes the ERM 206 or 210 to rotate in its single 
rotary direction. Thus, the periodic control signal has a frequency based on the desired 
(commanded) frequency. By pulsing the actuator once per period using control signal 254, the 
10 perception of a vibration with specified frequency is conveyed to the user. The control .signal 
can be raised to a high level at the begixming of a period, as shown, or at a different time within 
the period. 

Magnitude of the periodic effect is portrayed by adjusting a duty cycle of the control 
signal, e.g. the duration at each period ("on-time per period") of the control signal 254. The 

15 control signal 254 is either on or off, but the amount of time per period for which the control 
signal remains on is detamined by the magnitude command or parameter. In Fig. 6, a sine wave 
with 50% of the possible magnitude is requested. According to the present invention, this 
requested magnitude generates a control signal 254 that comes on every 250ms for 15ms 
duration. For comparison, a 100% magnitude waveform with the same frequency is offered in 

20 FIGURE 7, which shows a similar graph 260 to graph 254. The control signal 264 comes on at 
the same interval as the control signal 254 described above, since the frequency command has 
not changed. However, the control signal 264 stays on twice as long to produce the feeling in the 
user of twice the magnitude of vibration. The longer that the control signal is on, the longer the 
actuator spends accelerating. In our case, the ERM reaches a larger angular velocity and, since 

25 force is proportional to the square of angular velocity, larger forces are perceived at the user's 
hand. Preferably, the mass is never allowed to stop rotating, so that static fiiction need be 
overcome only once, at the start of rotation. If the control signal remains on too long, the 
rotating mass will make multiple revolutions and eventually reach its natural (resonant) 
frequency. At that point, the user will perceive the natural frequency of the system and not the 

30 conmianded frequency; 

Thus, according to the present invention, 1) how often the control signal comes on 
depends directly on frequency command, and 2) how long the control signal remains on (control 
signal on-time) is related to the magnitude command. The determination of the on-time of the 
control signal can be accomplished in different ways. Two different ways are presented here. 
35 First, on-time can be regulated as a "percentage of period." If the control signal comes on for a 
fixed percentage of each period, as frequency increases, on-time per period decreases. Yet the 
control signal comes on more often. The end result is that the control signal spends the same 
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amount of time on each second, no matter what the frequency. This technique offers the 
advantage that, as frequency increases, constant power is added to the actuator, and perceived 
magnitude stays the same over the frequency range. 

A problem with tins **percentage of period" technique for commanding a desired 
5 vibration is that in many embodiments it may not work well at lower frequencies. At low 
frequencies (e.g., less than 2 Hz in some embodiments), too much power is delivered to the 
actuator at once. For example, if all the power from a 1 second period is delivered in a 
continuous 125 ms at the beginning of the period, during this on-time, the rotating actuators 
make several revolutions while the control signal is held high, so that vibrations (pulses) output 
10 during this 125ms are perceived by the user at the frequency of the actuator's rotation speed, not 
the coimnanded frequency. The vibration output by the device thus may not correspond with the 
commanded (low) frequency. 

A second method of the present invention can avoid this problem at low frequencies and 
thus may provide a more suitable way to output vibrations for many ERM vibrotactile devices. 

15 The second method sets the control signal high for a fixed maximum amount of time per period, 
not a percentage of the period. Thus, the on-time for 100% magnitude for any frequency is the 
same. The on-time for commanded magnitudes less than 100% are lower in proportion to the 
amount of the commanded magnitude imder 100%. This effectively establishes a maximum on- 
time per period, prohibiting the actuator from coming on long enough to make mxiltiple 

20 revolutions during one continuous on-time. If the actuator is allowed to make multiple 
revolutions (e.g., more than about 2 or 3 in some embodiments), the user will perceive a higher 
frequency based on the rotation speed of the actuator rather than the commanded frequency (e.g., 
which nught be less than 10 Hz), so this method prevents that result. In some embodiments, a 
request of 100% magnitude at a lower frequency for a particular motor can be equated with the 

25 on-time that causes the mass to rotate just under the number of revolutions that cause the user to 
feel more than one pulse for a single period (such as 2-3 revolutions); this on-time can be 
determined empirically. A drawback to the second technique is that as frequency increases, the 
separate on-times get closer together, and the actuator is eventually, in effect, requested to 
remain on for longer than one period. At that point, the control signal is always being asserted, 

30 the mass rotates continuously, and frequency and magnitude no longer vary independently. 

Since the two techniques for mapping magnitude to on-time of the control signal are 
good for different portions of the frequency range, one preferred embodiment combines or 
blends the two techniques to avoid the drawbacks in each method, hi the preferred combination 
method, the second method is used only when commanded frequencies are below a particular 
35 blend threshold frequency and the first method can be used for commanded frequencies above 
that threshold frequency. Blending is possible even if the magnitude of the control signal also 
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varies. First, the blend threshold is chosen based on dynamics of the system; the blend frequency 
is the frequency at which the on-time will be the longest, so a blend frequency should be chosen 
that wDl provide one vibration pulse (e.g. less than two mass revolutions) per period for an on- 
trnie corresponding to 100% magnitude at that frequency. For example, when using the large 
motor/mass combination as described above, 10 Hz can be used as a blend threshold frequency. 
For commanded frequencies above 10 Ez, the first method (^'percentage of period") is used to 
calculate the on-time of the control signal, and for commanded frequencies below 10 Hz, the 
second method ("fixed time per period") can be used. Other thresholds can be used in other 
embodiments. To blend the two methods, scalars are chosen so that maximum magnitude for the 
two methods matches at the blend threshold frequency, i.e. the transition between methods is 
smooth. For example, a 25 ms control signal on-time at 10 Hz may generate a 10 Hz, 100% 
magnitude vibration. If the commanded frequency is approaching the blend frequency from 
below 10 Hz, then the "percentage of period" method is scaled to generate 25 ms on-times at 10 
Hz, and those scalars used are retained and applied to this method for frequencies above 10 Hz. 
Depending on the desired effect, more advanced blending techniques can be used such as those 
that mimic band pass filters in the region of the blend, or low pass/high pass combinations on 
either side of the blend threshold frequency. 

A different method to allow the command of magnitude independent of frequency is to 
vary the amplitude of the control signal 254 proportionally to requested magnitude, rather than 
20 having only two levels for the control signal. This can be performed alone or in conjunction 
with either or both of the first and second methods described above. For example, other types of 
waveforms having varying amplitude might be used as control signals (sine wave, triangle wave, 
etc.). One efficient way to set or vary the amplitude of the control signal is to provide pulse- 
width modulation (PWM) during the chosen on-time for control signals as presented above, or to 
25 vary the control signal duty cycle during the on-time using some other method. However, PWM 
may require a separate PWM module, which can add cost to the device. To avoid a PWM 
scheme, the first and second methods described above can be implemented by bit-banging, in 
which the local microprocessor outputs the control signal directly to the actuators without using 
a PWM module. Bit-banging does not allow the control signal magnitude to be directly 
30 controlled, but removes the requirement for a PWM module and potentially reduces processor or 
interface device cost. 

The techniques described above for independently varying the magnitude and frequency 
of a vibration can be used on multiple actuators simultaneously, as in the embodiment of Figs. 
5a-5b. Additional inventive features for this control technique are described below. 
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The control signal described above is used to control magnitude and frequency of output 
vibrations independently of each other. This control method can be used for multiple actuators, 
such as actuator assemblies 202 and 204. For example, both assemblies 202 and 204 can be 
S activated simultaneously, each using a dedicated control signal. 

One problem v/ith operating multiple actuator assemblies simultaneously is that 
significant amounts of power are required to drive the actuators. In some embodiments, a 
smaller amount of available power may restrict the use of multiple actuator assemblies. For 
example, if the interface device 12 is powered from the host computer 14 over a communication 

10 chaimel such as USB that also provides a limited amoimt of power, and does not have its own 
dedicated power supply, the amoimt of available power to operate the actuator assemblies is 
quite restricted. Or, in the case of an interface device 12 that has only a wireless link to the host 
computer, batteries (or other portable power storage device) with limited power are used in the 
interface device to drive the actuators. In many cases with such power restrictions, less 

IS compelling haptic sensations are output when using two or more actuator assemblies 
simultaneously. 

One method of the present invention allows two actuator assemblies to be operated 
simultaneously with a restricted available power budget. FIGURES 8a and 8b are graphs 270 
and 272 showing control signals for rotating the ERMs, as described above, to independently 

20 control magnitude and frequency. Graph 270 shows the control signal 274 applied to one 
actuator assembly (e.g. assembly 202), and graph 272 shows the control signal 276 appUed to the 
other actuator assembly (e.g. assembly 204). Control signals 274 and 276 have the same 
frequencies and periods Tl and T2. Control signal 274 has an on-time when the signal is high 
and an off-time when the signal is low, where the duty cycle is shown to be about 40%. While 

25 the control signal 274 is on, all or most of the available power is used to rotate the motor and 
thus provide a high-magnitude vibration. However, while control signal 274 is on, control signal 
276 remains off. Control signal 276 comes on at a point when control signal 274 is off and 
signal 276 goes off before control signal 274 comes back on. Thus, control signal 276 is 
sufficiently phase-shifted from signal 274 so that the control signals are never on at the same 

30 time. This allows all the available power to be used for a single actuator at any one time, and the 
available power need not be divided between the two actuator assembhes 202 and 204. 

Alternatively, control signal 276 can be made to lag only a small amount behind the 
control signal 274. This can be usefiil in cases where an ERM may require more power to start 
up rotating from rest (or other condition), but requires less power to remain rotating. For 
35 example, if the required start up current for both ERMs is greater than the available power 
budget, the required start up current for one ERM plus flie required rotating current for the other 
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ERM may be within the available power budget, thus allowing a second ERM to be started up 
very soon after the first ERM is started up and rotating. In some embodiments, the less 
interlaced the control signals, the more effective the vibration the user feels, since the resulting 
vibrations from each actuator assembly are more synchronized and less likely to "wash" each 
5 other out. 

The control signals 274 and 276 can be varied in frequency and duty cycle (their on-time 
widths shifted) to produce varying vibration magnitudes as described above with reference to 
Figs. 6 and 7. When so varied, the control signals are preferably maintained at the same 
frequency and duty cycle. This produces vibrations that are non-directional to the user, e.g. 
10 output as if from the entire housing, equal on both sides of the housing. 

The control signals used in the method described above with respect to Figs. 6 and 7 
preferably do not have greater than a 50% duty cycle, since in many OTibodimmts this would 
cause the actuator assembly to being operating at its natural frequency rather than the 
commanded frequency, e.g. the user feels the frequency of the ERM spinning continuously, not 
15 the commanded frequency. Thus, this method can be effective and allocating power to provide 
the strongest possible vibrations on a limited power budget, since interlacing is possible. Thus, 
this interlacing method allows independent control of magnitude and frequency of vibrations 
output by two actuators in a power-efficient scheme. 

FIGURES 9a and 9b are graphs 280 and 282 illustrating a power allocation method of the 
20 present invention for control signals having different frequencies and/or overlap. Graph 280 
illustrates a control signal 284 having a particular frequency and period Tl, and graph 282 
illustrates a control signal 286 having a particular frequency and period T2. The on-times of the 
signals overlap for an amount of time A, which is typically different for each period. Overlap 
may be unavoidable in some circumstances where a larger than 50% duty cycle is required or 
25 when the control signals are of different frequencies and/or duty cycles. For example, one 
actuator assembly 202 may be commanded to output a vibration at one frequency, while the 
other actuator assembly 204 may be commanded to output a vibration at a different frequency, to 
achieve a particular haptic sensation as felt by the user. 

To allow a restricted power budget to be used in such a situation according to the present 
30 invention, the control signal is preferably tumed off and on at a predetermined duty cycle and 
frequency during the time A of the overlap. This allows the average power consumption for 
each actuator to be reduced during those times when both actuators are being operated, and thus 
pem[iits the available power budget to be efficiently used. For example, as shown in FIGURE 
9c, the control signal 284 is pulsed at a particular duty cycle and higher frequency during the 
35 overlap time period A, which allows the power requirements for control signal 284 to be reduced 
during that overlap. This is effectively a PWM type of control This causes the actuator 
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vibration output magnitude to be reduced (which is only slightly noticeable to the user). 
Meanwhile, the control signal 286 is also pulsed at a particular duty cycle and frequency (as 
shown by the dotted line 288 in Fig. 6b) during the overlap period. The available power is thus 
shared between the two actuator assemblies to cause a reduced output by each actuator within the 
5 available power budget. The shown frequencies of the control signals during the overlap are 
exaggerated in the figures to be lower than the actual frequencies that can be used. 

The duty cycle and/or frequency at which the control signal is pulsed during the overlap 
period can be determined from the operating characteristics of the interface device 12, e.g. the 
characteristics of the actuators, ERM's, amplifiers, etc. A duty cycle can be chosen which 

10 reduces the power requirements of the control signal to a desired level that allows both actuators 
to operate within the power budget during the overlap, e.g. the effective overlap magnitude can 
be 75% of the full magnitude when the control signal remains on continuously. There is 
typically no need to arrange the control signals so that the pulses during the overlap period are 
not on at the same time. This is due to the relatively high frequency of the control signals, which 

15 allows components in the drive circuit such as capacitors to charge sufficiently to maintain the 
desired power level even though both control signals are high. In other embodiments, the control 
signals during the overlap period can be arranged, if possible, to be on at alternating times so that 
the control signals are not on simultaneously. The frequency of the controls signals during the 
overlap period is chosen based on the ability of the driver circuits with capacitors and other 

20 energy storage components to maintain the desired power level. 

In some embodiments, the duty cycle of the control signals during the overlap period can 
be adjuisted based on the frequencies or periods T of the two control signals. For example, in 
general, the smaller the period Tl and T2 of the control signals (and the higher the frequencies), 
the more power is required to operate the actuators. If either or both control signal has a small 

25 period, then the duty cycle of the control signals during the overlap can be reduced to consume 
less power, i.e. cause a lesser effective magnitude during the overlap period. In some 
embodiments, if the period Tl or T2 is very long, the ERM may gain momentum during the 
latter part of the on-time and require less power to rotate, and this can be taken into accoxmt 
when determining a duty cycle of the control signal during the overlap period. In some 

30 embodiments, the duty cycle can be increased for high frequency control signals so that the high 
frequency vibrations don't get *Vashed out" by lower frequency vibrations output by the other 
actuator. 

The control signals can each have a different duty cycle and/or frequency during the 
overlap period based on individual characteristics of the actuator assemblies. In some 
35 embodiments, only one control signal is pulsed during the overlap period. 
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A local processor (see Fig. 11) may control how to phase shift the control signals and/or 
pulse the control signals during overlap periods. For example, in the alternating on-times 
embodiment of Figs. 5a and 5b, a microprocessor can monitor when control signals are sent and 
can only send one control signal when other control signal is off. 

5 The power-efficient control methods described above can also be used in other 

embodiments having other types of actuators which can be controlled with similar control signals 
or other signals with on-times. 



Directional Sensations using Rotary Inertial Actuator Assemblies 

10 The control methods described above can be used to control magnitude and frequency of 

output vibrations independently of each other in a power-restricted device. This control method 
can also be used in conjunction with methods of outputting directional inertial haptic sensations 
described above. 

FIGURES 10a, 10b, 10c and lOd are graphs 310, 312, 314, and 316, respectively, 
15 illustrating control signals in a control method of the present invention for use with the two 
actuator embodiment described with reference to Figs. 5a-5b to provide directional tactile 
feedback, in this case, tactile feedback that can be spatially placed by the user at a location 
between the two actuators. Graphs 310 ahd 312 illustrate control signals 318 and 320 which are 
similar to the signals of Figs. 8a and 8b and cause a desired magnitude and frequency of 
20 vibration as determined by the methods of Figs. 6 and 7. The control signals can be adjusted 
with other parameters, if desired, such as duration, envelopes, etc. 

After the desired are determined, then the control signals are then fiirther modified to 
provide the directionality or '"balance" described below. In graph 314 of Fig. 10c, control signal 
322 is reduced in on-time to provide less average current to a first actuator assembly, while in 

25 graph 316 of Fig. lOd, control signal 324 is increased in on-time by the same amount that control 
signal 322 is reduced to provide a greater average current to a second actuator assembly. Thus, a 
first actuator assembly is provided with an additional amount of power while the second actuator 
is provided with less power, by the amount of additional power supplied to the first actuator. For 
example, control signal 324 has a greater duty cycle, e.g. increased by 25%, thus providing the 

30 actuator with more power and causing stronger vibrations to be output. Control signal 322 has a 
lower duty cycle by a corresponding amount (25%), causing lower magnitude vibrations to be 
output from that actuator, so that the fiill 100% of commanded magnitude has been differently 
distributed between the two actuator assemblies. 
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Thus, the magnitudes of the vibrations are scaled by dividing the commanded magnitude 
between the two actuator assemblies 202 and 204. To provide a vibration or other inertia! force 
sensation that has no perceived direction to the user, both actuator assemblies are provided with 
an equal amount of power (average current), so that equal magnitude vibrations are output from 
5 each actuator, as in Figs lOa-lOb. If, however, the inertial sensation is to have a perceived 
direction, then the on-times of the control signals are adjusted, i.e. one actuator is provided with 
more average current than the other, and greater magnitude inertial forces are output by one 
actuator than the other actuator. If control signal 324 is applied to the actuator assembly 204 on 
the left of the gamepad device 200, then a left direction is to be perceived by the user since the 
10 left vibration has a greater magnitude. If a ri^t direction is to be output, then the actuator 202 
on the right side of the device is provided with the greater amount of average current. The user 
perceives a stronger vibration on one side of the device as a directional vibration. If for example, 
the user's vehicle in a game crashes into a barrier on the left, the left actuator can output a 
istronger vibration to indicate the direction of this collision. 

15 Dq)ending on the division of commanded magnitude between the two actuators, the user 

perceives the output inertial sensations at a location somewhere between the two actuator 
assemblies, where the stronger one force is, the closer to that actuator assembly the user 
perceives the resultant force to be output. This is similar to the locations illustrated in Fig. 4 
above. One way to command the direction in this way is to specify a "balance" parameter, as 

20 described above, or have the host directly command the actuator assemblies. Additional 
actuators can also be implemented in embodiment 200 similar to the embodiment 100 described 
above, and a sweep effect can be commanded and output using the embodiment 200. 

FIGURE 1 1 is a block diagram illustrating one embodiment of a haptic feedback system 
suitable for use with the present inventions. 

25 Host computer system 14 preferably includes a host microprocessor 400, a clock 402, a 

display screen 26, and an audio output device 404. The host computer also includes other well 
known components, such as random access memory (RAM), read-only memory (ROM), and 
input/output Q/0) electronics (not shown). Display screen 26 displays images of a game 
environment, operating system application, simulation, etc. and audio output device 404, such as 

30 speakers, provides sound output to user. Other types of peripherals can also be coupled to host 
processor 400, such as storage devices (hard disk drive, CD ROM drive, floppy disk drive, etc.), 
printers, and other input and output devices. 

The interface device 12, such as a mouse, gamepad, etc., is coupled to host computer 
system 14 by a bi-directional bus 20 The bi-directional bus sends signals in either direction 
35 between host computer system 14 and the interface device. Bus 20 can be a serial interface bus, 
such as an RS232 serial interface, RS-422, Universal Serial Bus (USB), MIDI, or other protocols 
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well known to those skilled in the art; or a parallel bus or wireless link, 
provide power to the actuators of the device 12. 
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Some interfaces can also 



Device 12 can include a local microprocessor 410. Local microprocessor 410 can 
optionally be included within the housing of device 12 to allow efficient commimication with 
5 other components of the mouse. Processor 410 is considered local to device 12, where "local" 
herein refers to processor 410 being a separate microprocessor from any processors in host 
computer system 14. 'Xocal" also preferably refers to processor 410 being dedicated to haptic 
feedback and sensor I/O of device 12. Microprocessor 410 can be provided with software 
instructions to wait for commands or requests from computer host 14, decode the command or 

10 request, and handle/control input and output signals according to the command or request. In 
addition, processor 410 can operate independently of host computer 14 by reading sensor signals 
and calculating appropriate forces from those sensor signals, time signals, and stored or relayed 
instructions selected in accordance with a host command. Microprocessor 410 can include one 
microprocessor chip, multiple processors and/or co-processor chips, and/or digital signal 

1 5 processor (DSP) capability. 

Microprocessor 410 can receive signals from sensor(s) 412 and provide signals to 
actuator assembly 54 in accordance with instructions provided by host computer 14 over bus 20. 
For example, in a local control embodiment, host computer 14 provides high level supervisory 
commands to microprocessor 410 over bus 20, and microprocessor 410 decodes the commands 

20 and manages low level force control loops to sensors and the actuator in accordance with the 
high level commands and independently of the host computer 14. This operation is described in 
greater detail in US Patent 5,734,373. In the host control loop, force commands are ou^ut from 
the host computer to microprocessor 410 and instruct the microprocessor to output a force or 
force sensation having specified characteristics. The local microprocessor 410 reports data to the 

25 host computer, such as locative data that describes the position of the mouse in one or more 
provided degrees of freedom. The data can also describe the states of buttons 24, d-pad 20, etc. 
The host computer uses the data to update executed programs. In the local control loop, actuator 
signals are provided from the microprocessor 410 to actuator assembly 434 and sensor signals 
are provided from the sensor 412 and other input devices 418 to the microprocessor 410. Herein, 

30 the term "hq)tic sensation" or **tactile sensation" refers to either a single force or a sequence of 
forces ou^ut by the actuator assemblies which provide a sensation to the user. The 
microprocessor 410 can process inputted sensor signals to determine appropriate output actuator 
signals by following stored instructions. The microprocessor may use sensor signals in the local 
determination of forces to be output on the user object, as well as reporting locative data derived 

35 from the sensor signals to the host computer. 
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In yet other embodiments, other simpler hardware can be provided locally to device 12 to 
provide functionality similar to microprocessor 410. For example, a hardware state machine 
incorporating fixed logic can be used to provide signals to the actuator assembly 434 and receive 
sensor signals from sensors 412, and to output tactile signals according to a predefined sequence, 
5 algorithm, or process. Techniques for implementing logic with desired functions in hardware are 
well known to those skilled in the art. 

In a different, host-controlled embodiment, host computer 14 can provide low-level force 
commands over bus 20, which are directly transmitted to the actuator assembUes 434 via 
microprocessor 410 or other (e.g. simpler) circuitry. »Host computer 14 thus directly controls and 
10 processes all signals to and from the device 12. 

In a simple host control embodiment, the signal from the host to the device can be a 
single bit that indicates whether to pulse the actuator at a predefined frequency and magnitude. 
In more complex embodiments, the signal from the host can include a magnitude, giving the 
strength of the desired pulse, and/or a direction, giving both a magnitude and a sense for the 

15 pulse. In more complex embodiments, a local processor can be used to receive a simple 
command from the host that indicates a desired force value to apply over time, which the 
microprocessor then outputs based on the one command. In a more complex embodiment, a 
high-level command with tactile sensation parameters can be passed to the local processor on the 
device which can then apply the full sensation independent of host intervention. A combination 

20 of these methods can be used for a single device 12. 

Local memory 422, such as RAM and/or ROM, is preferably coupled to microprocessor 
410 in mouse 12 to store instructions for microprocessor 410 and store temporary and other data. 
For example, force profiles can be stored in memory 422, such as a sequence of stored force 
values that can be output by the microprocessor, or a look-up table of force values to be output 

25 based on the current position of the user object. In addition, a local clock 424 can be coupled to 
the microprocessor 410 to provide timing data, similar to the system clock of host computer 12; 
the timing data might be required, for example, to compute forces output by actuator assembly 
434 (e.g., forces dependent on calculated velocities or other time dependent factors). In 
embodiments using the USB communication interface, timing data for microprocessor 410 can 

30 be alternatively retrieved from the USB signal. 

Sensors 412 sense the position or motion of the device and/or one or more 
manipulandums or controls and provides signals to microprocessor 410 (or host 14) including 
information representative of the position or motion. Sensors suitable for detecting manipulation 
include digital optical encoders, optical sensor systems, linear optical encoders, potentiometers, 
35 optical sensors, velocity sensors, acceleration sensors, strain gauge, or other types of sensors can 
also be used, and either relative or absolute sensors can be provided. Optional sensor interface 
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414 can be used to convert sensor signals to signals that caa be interpreted by the microprocessor 
410 and/or host computer system 14, as is well known to those skilled in the art. 



Actuator assemblies 434 transmit forces to the housing of the device 12 as described 
above in response to signals received from microprocessor 410 and/or host computer 14. 
5 Actuator assembly 434 can generate inertial forces by, for example, moving an iriertial mass. 
Other types of actuators can also be used, such as actuators that drive a member against the 
housing to generate a tactile sensation. 

Actuator interface 416 can be optionally connected between actuator assemblies 434 and 
microprocessor 410 to convert signals from microprocessor 410 into signals appropriate to drive 
10 actuator assembly 434. Interface 416 can include power amplifiers, sv^tches, digital to analog 
controllers (DACs), analog to digital controllers (ADCs), and other components. Other input 
devices 41 8 are included in device 12 and send input signals to nucroprocessor 410 or to host 14 
when manipulated by the user. Such input devices include buttons 24, d-pad 20, etc. and can 
include additional buttons, dials, switches; scroll wheels, or other controls or mechanisms. . 

15 Power supply 420 can optionally be included in device 12 coupled to actuator interface 

416 and/or actuator assembly 434 to provide electrical power to tiie actuator, or be provided as a 
separate component. Altematively, power can be drawn from a power supply separate from 
device 12, or be received across the bus 20. Also, received power can be stored and regulated 
by device 12 and thus used when needed to drive actuator assemblies 434 or used in a 

20 supplementary fashion. Some embodiments can use a power storage device in the device to 
ensure that peak forces can be applied (as described in U.S. Patent No. 5,929,607). 
Altematively, this technology can be employed in a wireless device, in which case battery power 
is used to drive the tactile actuators. A safety switch 432 can optionally be included to allow a 
user to deactivate actuator assemblies 434 for safety reasons. 

25 While this invention has been described in terms of several prefOTed embodiments, it is 

contemplated that alterations, permutations and equivalents thereof will become apparent to 
those skilled in the art upon a reading of the specification and study of the drawings. For 
example, many different embodiments of haptic feedback devices can be used to output the 
tactile sensations described herein, including joysticks, steering wheels, gamepads, and remote 

30 controls. Furthemiore, certain terminology has been used for the purposes of descriptive clarity, 
and not to limit the present invention. 
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CLAIMS 



5 L An interface device providing directional haptic feedback to a user, said interface 

device in conmiunication with a host computer, the device comprising: 

a housing physically contacted by said user, 

at least one sensor for detecting user input from said user; and 

at least two actuator assemblies coupled to said housing, each of said actuator assemblies 
1 0 including a moving inertial mass, wherein said actuator assembhes are positioned in said housing 
to cause directional inertial sensations on said housing, wherein a single control signal is 
provided to each of said actuator assemblies at different magnitudes to provide said directional 
inertial sensations felt by said user. 

2. An interface device as recited in claim 1 wherein a greater magnitude of said 
IS waveform is appUed to a particular one of said actuator assembhes to provide a sensation having 

a direction approximately corresponding to a position of said particular actuator assembly in said 
housing. 

3. An interface device as recited in claim 2 wherein a greater magnitude of said 
waveform is applied to a left one of said actuator assemblies to provide a sensation having a left 

20 direction, and wherein a greater magnitude of said waveform is appUed to a right one of said 
actuator assemblies to provide a sensation having a right direction. 

4. An interface device as recited in claim 1 further comprising a local processor that 
receives a high level command from said computer and controls said actuator assembhes in 
accordance with said high level command. 

25 5. An interface device as recited in claim 4 wherein said high level command includes a 

balance parameter, said balance parameter indicating how to divide an ou^ut current between 
said actuator assembhes to provide a desired location for said directional inertial sensation along 
an axis between said actuator assemblies. 
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6. An interface device as recited in claim 5 wherein said high level command includes 
frequency and magnitude parameters for specifying a frequency and magnitude of said inertia! 
sensations, said frequency and magnitude being independent of each other. 

7. An interface device as recited in claim 5 wherein said high level conmiand includes at 
S least one envelope parameter for specifying an envelope on said inertial sensations, said 

envelope modifying said magnitude of said inertial sensations. 

8. An interface device as recited in claim 1 wherein each of said actuator assemblies 
oscillates said inertial mass linearly. 

9. An interface device as recited in claim 8 wherein said control signal is harmonic and 
1 0 drives said inertial mass in two directions. 

10. An interface device as recited in claim 1 wherein said control signal is divided into 
two control signals, one of said control signals being out of phase with the other control signal, 
each control signal sent to one of said actuator assemblies. 

11. An interface device as recited in claim 1 wherein each of said actuator assembUes 
1 S rotates said inertial mass. 

12. An interface device as recited in claim 1 1 wherein said inertial masses are rotated 
only in one rotational direction. 

13. An interface device as recited in claim 12 wherein a magnitude and frequency of 
each of individual inertial sensations produced by each of said actuator assembUes are adjustable 

20 independently of each other. 

14. An interface device as recited in claim 1 wherein said housing includes two grips, 
and wherein each of said actuator assemblies is in one of said grips. 



15. An interface device providing directional haptic feedback to a user, said interface 
25 device providing said haptic feedback in accordance with a display of a computer, the device 
comprising: 

a housing physically contacted by said user; 

at least one sensor for detecting user input from said user; and 

at least two actuator assembUes coupled to said housing, each of said actuator assembUes 
30 including a rotary inertial mass that is driven uni-directionally, wherein said actuator assembUes 
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are positioned in said housing to cause directional inertial sensations on said housing, wherein a 
control signal is provided to each of said actuator assemblies at a different duty cycle to provide 
said directional inertial sensations felt by said user. 

16. An interface device as recited in claim 14 wherein a commanded magnitude of said 
5 control signal is applied to a left one of said actuator assemblies to provide a sensation having a 

left direction, and wherein a commanded magnitude of said control signal is applied to a rigjit 
one of said actuator assemblies to provide a sensation having a right direction. 

17. A interface device as recited in claim IS further comprising a local processor that 
receives a high level command firom said computer and controls said actuator assemblies in 

10 accordance with said high level command. 

18. A interface device as recited in claim 17 wherein said high level command includes a 
balance parameter, said balance parameter indicating how to divide output vibration magnitudes 
between said actuator assemblies to provide a desired location for said directional inertial 
sensation along an axis between said actuator assemblies. 

15 19. A interface device as recited in claim 18 wherein said higih level command includes 

frequency and magnitude parameters for specifying a frequency and magnitude of said inertial 
sensations, said frequency and magnitude being independent of each other. 

20. A interface device as recited in claim 18 wherein said high level command includes at 
least one envelope parameter for speci^dng an envelope on said inertial sensations, said 

20 envelope modifying said magnitude of said inertial sensations. 

21. An interface device as recited in claim 15 wherein one of said control signals is out 
of phase with the other control signal, each control signal sent to one of said actuator assemblies. 

22. An interface device as recited in claim IS wherein one of said control signals is out 
of phase from said other control signal. 

25 23. An interface device as recited in claim 22 wherein one of said control signals is 

interlaced with said other control signal such that said control signals are never on at the same 
time. 

24. An interface device as recited in claim 15 wherein when one of said control signals is 
on at the same time as the other control signal, at least one of said control signals is pulsed at a 
30 predetermined frequency and duty cycle to reduce average power requirements of at least one of 
said actuator assemblies. 
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25. A method for providing directional haptic feedback to a user manipulating an 
interface device, said interface device in communication with a host computer, the method 
comprising: 

detecting input from said user based on said manipulation of said interface device; and 

5 outputting a directional inertial sensation on a housing of said interface device physically 

contacted by said user, wherein said directional inertial sensation is caused by at least two 
actuator assemblies, each of said actuator assembUes moving an inertial mass, wherein said 
actuator assemblies are positioned in said housing to cause said directional inertial sensations 
and wherein a single control signal is provided to each of said actuator assemblies at different. 
1 0 magnitudes to provide said directional inertial sensations felt by said user. 



26. A method as recited in claim 25 wherein a greater magnitude of said waveform is 
applied to a particular one of said actuator assemblies to provide a sensation having a direction 
^proximately corresponding to a position of said particular actuator assembly in said housing. 

15 27. A method as recited in claim 26 wherein a greater magnitude of said waveform is 

applied to a left one of said actuator assembUes to provide a sensation having a left direction, and 
wherein a greater magnitude of said waveform is applied to a rigjit one of said actuator 
assemblies to provide a sensation having a right direction. 

28. A method as recited in claim 26 further comprising a local processor that receives a 
20 high level command from said computer and controls said actuator assemblies in accordance 
with said high level command, wherein said high level command includes a balance parameter, 
said balance parameter indicating how to divide an output current between said actuator 
assembUes to provide a desired location for said directional inertial sensation along an axis 
between said actuator assembUes. 

25 29. A method as recited in claim 28 wherein said higjh level command includes 

frequency and magnitude parameters for specifying a frequency and magnitude of said inertial 
sensations, said frequency and magnitude being independent of each other. 

30. An interface device as recited in claim 25 wherein each of said actuator assemblies 
oscillates said inertial mass linearly, wherein said control signal is harmonic and drives said 
30 inertial mass in two directions. 
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31. An interface device as recited in claim 25 wherein said control signal is divided into 
two control signals, one of said control signals being out of phase with the other control signal, 
each control signal sent to one of said actuator assembhes. 

32. An interface device as recited in claim 25 wherein each of said actuator assemblies 
5 rotates said inertial mass. 



33. A method for providing directional haptic feedback to a user manipulating an 
interface device, said interface device in communication with a host computer, the method 
comprising: 

10 detecting input from said user based on said manipulation of said interface device; and 

outputting a directional inertial sensation on a housing of said interface device physically 
contacted by said user, wherein said directional inertial sensation is caused by at least two 
actuator assembhes, each of said actuator assembhes rotating an inertial mass uni-directionally, 
wherein said actuator assembhes are positioned in said housing to cause said directional inertial 
15 sensation and wherein a control signal is provided to each of said actuator assembhes at a 
different duty cycle to provide said directional inertial sensation felt by said user. 



34. A method as recited in claim 33 wherein a commanded magnitude of said control 
signal is appUed to a left one of said actuator assembhes to provide a sensation having a left 

20 direction, and wherein a commanded magnitude of said control signal is apphed to a right one of 
said actuator assemblies to provide a sensation having a right direction. 

35. A method as recited in claim 33 wherein a received high level command from said 
host computer controls said actuator assembhes and includes a balance parameter, said balance 
parameter indicating how to divide output vibration magnitudes between said actuator 

25 assembhes to provide a desired location for said directional inertial sensation along an axis 
between said actuator assemblies. 

36. A method as recited in claim 35 wherein said high level command includes 
frequency and magnitude parameters for specifying a frequency and magnitude of said inertial 
sensations, said frequency and magnitude being mdependent of each other. 

30 37, A method as recited in claim 33 wherein one of said control signals is out of phase 

from said other control signal. 
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38. A method as recited in claim 37 wherein one of said control signals is interlaced with 
said other control signal such that said control signals are never on at the same time, 

39. A method as recited in claim 33 wherein when one of said control signals is on at the 
same time as the other control signal, at least one of said control signals is pulsed at a 

5 predetermined frequency and duty cycle to reduce average power requirements of at least one of 
said actuator assemblies. 
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